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(57) Abstract: A method of determining an amount of at least one 
molecular specie comprising a sample is provided, each molecular 
spede being indicated by a dye. The amount of the molecular specie 
is determined &om an image of the sample captured as image data by 
a color image acquisition device in a video-microscopy system. An 
optical density of the sample is first determined in each of a red, green, 
and blue channel at a particular pixel in the image. A corresponding 
optical density matrix is thereafter formed for that pixel. The optical 
density matrix is then multiplied by the inverse of a relative absorption 
coefficient matrix so as to form a resultant matrix for the pixel. The 
relative absorption coefficient matrix comprises a relative absorption 
coefficient for each dye, inde|>endently of the sample, in each of the 
red, green, and blue channels. The resultant matrix thus comprises the 
amount of each molecular specie, as indicated by the respective dye, for 
that pixel. Associated systems and computer software program products 
are also provided. 
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METHOD FOR QUANTITATIVE VIDEO-MICROSCOPY AND ASSOCIATED 
SYSTEM AND COMPUTER SOFTWARE PROGRAM PRODUCT 

FIELD OF THE INVENTION 
The present invention relates to image analysis and, more particularly, to a 
method for quantitative video-microscopy in cellular biology and pathology 
applications and an associated system and computer software program product 
therefor. 

5 

BACKGROUND OF THE INVENTION 
Effective analysis of microscopic images is essmtial in cellular biology and 
pathology, particularly for detection and quantification of genetic materials such as, 
for example, genes or messenger RNA, or the expression of this genetic information 

10 in the form of proteins such as through, for example, gene amplification, gene 
deletion, gene mutation, messenger RNA molecule quantification, or protein 
expression analyses. Gene amplification is the presence of too many copies of the 
same gene in one ceU, wherein a cell usually contains two copies, otherwise known as 
alleles, of the same gene. Gene deletion indicates that less than two copies of a gene 

15 can be foimd in a cell Gene mutation indicates the presence of incomplete or non- 
functional genes. Messenger RNAs (mRNA) are molecules of genetic information, 
synthesized fi'om a gene reading process, that serve as templates for proteui synthesis. 
Protein e>q)ression is the production of a given protein by a cell. If the gene coding 
for the given protein, determined &om a protein expression process, is enhanced or 

20 excess copies of the gene or noRNA are present, the protein may be over-expressed. 
Conversely, if the gene coding is suppressed or absent, the protein maybe under- 
expressed or absent. 

Normal cellular behaviors are precisely controlled by molecular mechanisms 
involving a large number of proteins, mRNAs, and genes. Gene amplification, g&ae 

25 deletion, and gene mutation are known to have a prominent role in abnormal cellular 
behaviors through abnormal protein expression. The range of cellular behaviors of 
concern includes behaviors as diverse as, for example, proliferation or differentiation 

1 
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regulation. Therefore, effective detection and quantification in gene amplification, 
deletion and mutation, mRNA quantification, or protein expression analyses is 
necessary in order to fecilitate useful research, diagnostic and prognostic tools. 
There are numerous laboratory techniques directed to detection and 
5 quantification in gene amplification, deletion and mutation, mRNA quantification, or 
protein expression analyses. For example, such techniques include Western, Northern 
and Southern blots, polymerase chain reaction ("PGR"), enzyme-linked 
immunoseparation assay ("ELISA"), and comparative genomic hybridization 
("CGH") techniques. However, microscopy is routinely utilized because it is an 

1 0 informative technique, allowing rapid investigations at the cellular and sub-cellular 
levels while capable of being expeditiously implemented at a relatively low cost. 

When microscopy is the chosen laboratory technique, the biological samples 
must first undergo specific detection and revelation preparations. Once the samples 
are prepared, a human expert typically analyzes the samples with a microscope alone 

15 in a quaUtative study, or with a microscope coupled to a camera and a computer in a 
quantitative and generally standardized study. In some instances, the microscope may 
be configured for fiilly automatic analysis, wherein the microscope is automated with 
a motorized stage and focus, motorized objective changers, automatic light intensity 
controls and the like. 

20 The preparation of the samples for detection may involve different types of 

preparation techniques that are suited to microscopic imaging analysis, such as, for 
example, hybridization-based and immxmolabeling-based preparation techniques. 
Such detection techniques may be coupled with appropriate revelation techniques, 
such as, for example, fluorescence-based and visible color reaction-based techniques. 

25 In Situ Hybridization ("ISH") and Fluorescent In Situ Hybridization ("FISH") 

are detection and revelation techniques used, for example, for detection and 
quantification in genetic information amplification and mutation analyses. Both ISH 
and FISH can be applied to histological or cytological samples. These techniques use 
specific complementary probes for recognizing corresponding precise sequences. 

30 Depending on the technique used, the specific probe may include a chemical (ISH) 
marker or a fluorescent (FISH) marker, wherein the samples are then analyzed using a 
transmission microscope or a fluorescence microscope, respectively. The use of a 
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chemical marker or a fluorescent marker depends on the goal of the user, each type of 
marker having corresponding advantages over the other in particular instances. 

In protein expression analyses, immimohistochemistry ("IHC") and 
immunocytochemistry ("ICC") techniques, for example, may be used. IHC is the 
5 application of immunochemistry to tissue sections, whereas ICC is the application of 
inununochemistry to cultured cells or tissue imprints after ttiey have undergone 
specific cytological preparations such as, for example, liquid-based preparations. 
Immunochemistry is a family of techniques based on the use of a specific antibody, 
wherein antibodies are used to specifically target molecules inside or on the surface of 

1 0 cells. The antibody typically contains a marker that will undergo a biochemical 
reaction, and thereby experience a change color, upon encountering the targeted 
molecules. In some instances, signal amplification may be integrated into the 
particular protocol, wherein a secondary antibody, that includes the nwker stain, 
follows the application of a primary specific antibody. 

IS In both hybridization and immunolabeling studies, chromogens of different 

colors are used to distinguish among the different markers. However, the maximum 
number of markers that may be used in a study is restricted by several factors. For 
example, the spectral overlapping of the colors used to reveal the respective markers 
may be a limiting factor because dyes may absorb throughout a large portion of the 

20 visible spectrum. Accordingly, the higher the number of dyes involved in a study, the 
higher the risk of spectral overlapping. Further, the spectral resolution of the 
acquisition device may be a limiting factor and the minimal color shift that the device 
is able to detect must be considered. 

In addition, immunochemistry, as well as chemistry in ISH, are generally 

25 considered to exhibit poor sensitivity when quantification of a marker must be 
achieved. However, the quantification accuracy of these techniques may be 
dependent upon several factors. For instance, the type of reaction used may play a 
role in the accuracy of the technique since the linearity of the relationship between 
ligand concentration and the degree of the immunochemical staining reaction may 

30 strongly depend on the reaction type. More particularly, for example, a peroxidase/ 
anti-peroxidase method may be more linear than a biotin-avidin method. The cellular 
localization of the markers may also affect accuracy where, for example, if membrane 
and nuclear markers spatially overlap, the resulting color is a mixture of the respective 
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colors. Accordingly, since the corresponding quantification is subjective, the 
accuracy of the determination may be affected. In addition, a calibration standard 
such as, for example, cells with known features, gels with given concentrations of the 
marker, or the like, may be required where a developed analysis model is applied to a 
5 new and different case. Staining kits are generally available which incorporate 

calibration standards. Howeva, the calibration standard is usually only applicable to 
a particular specimen, such as a specific cell or a structure of a specific type which is 
known to exhibit constant features with respect to the standard, and may be of limited 
utility when applied to a sample of a different nature. 

1 0 Overall, the described "colorimetric" studies present sample analysis 

information in color and facilitate processing and quantification of the information to 
thereby help to provide a diagnosis or to form a prognosis of the particular case. For 
illustration, the detection and quantification of the HER2 protein expression and/or 
gene amplification may be assessed by different approaches used in quantitative 

IS microscopy. HER2 is a membrane protein that has been shown to have a diagnostic 
and prognostic significance in metastatic breast cancer. Because HER2 positive 
patients were shown to be more sensitive to treatments including Herceptin® (a target 
treatment developed by Genentech), the definition of the HER2 status of metastatic 
breast cancers has been proven to be of first importance in the choice of the 

20 appropriate treatment protocol. This definition of the HER2 status was based on a 
study of samples treated with either hybridization (FISH, ISH) or immunolabeling 
(IHC) techniques. 

In such studies, using FISH with, for example, an FDA approved kit such as 
PathVysion® produced by Vysis, requires an image analysis protocol for counting the 

25 nimiber of copies of the HER2 gene present in every cell. In a normal case, two 
, copies of the gene are found in each cell, whereas more than three copies of the gene 
in a cell indicate that the gene is amplified. Alternatively, using IHC with, for 
example, an FDA approved kit such as Herceptest® produced by Dako, requires an 
image analysis protocol that classified the cases into four categories depending on the 

30 intensity and localization of the HER2 specific membrane staining. Current studies 
tend to show that these two investigation techniques (hybridization and 
immunolabeling) may be complementary and may help pathologists in tumor sub-type 
diagnosis when combined. 
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However, such colorimetry studies require extensive sample preparation and 
procedure control. Thus, when disposing of adapted staining protocols, it is critical to 
be able to verify that the staining for each sample matches the particular model used 
in the image acquisition and processing device such that useful and accurate results 
5 are obtained from the gathered information. Otherwise, the analysis may have to be 
repeated, starting again from the sample preparation stage, thereby possibly resulting 
in a costly and time-consuming process. 

In a typical microscopy device based on image acquisition and processing, the 
magnified image of the sample must first be captured and digitized with a camera. 

1 0 Generally, charge coupled device (CCD) digital cameras are used in either light or 
fluorescence quantitative microscopy. Excluding spectrophotometers, two diflferOTt 
techniques are generally used to perform such colorimetric microscopy studies. Li 
one technique, a black and white (B W) CCD camera may be used. In such an 
instance, a gray level image of the sample is obtained, corresponding to a 

15 monochromatic ligjht having a wavelength specific to the staining of the sample to be 
analyzed. The specific wavelength of light is obtained either by filtering a white 
source light via a specific narrow bandwidth filter, or by directly controlling the 
wavelength of the light source, using either manual or electronic controls. 
Accordingly, using this technique, the analysis time increases as the number of colors 

20 increases because a light source or a filter must be selected for every different sample 
staining or every different wavelength* Therefore, many different images of the 
sample, showing the spectral response of the sample at different wavelengths, must be 
individually captured in a sequential order to facilitate the analysis. When multiple 
scenes or fields of view must be analyzed, the typical protocol is to automate the 

25 sequence in a batch mode to conserve processiag time. 

According to a second technique, a color CCD digital camera is used, wherein 
three gray level images of the sample are simultaneously captured and obtained. Each 
gray level image corresponds to the respective Red, Green and Blue channel (RGB) of 
the color CCD camera. The images are then analyzed directly in the RGB color space 

30 by restricting the analysis to pixels located in a specific region of the RGB cube, the 
specific region also including pixels Scorn a corresponding training database. 
Alternatively, the unages are analyzed, after mathematical transform of the RGB 
color space, in one of the many color spaces defined by the CIE (International 
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Commission on Illumination) such as, for example, an HLS (Hue, Luminance or 
Saturation) space. Altematively, some camera manufacturers produce specific CCD 
cameras, wherein narrow bandwidth filters for targeting specific wavelengths may 
replace the usual Red, Green and Blue filters* In such an instance, the camera allows 
S a fast image capture of the three spectral components of a scene m a parallel manner. 
However, cameras modified in this manner may be restricted to specific spectral 
analysis parameters because the filters caimot be changed and therefore caimot be 
adapted to address a unique dye combination used for the sample. Thus, the second 
technique generally rehes upon either the detection of contrast between the 

10 specie/species of interest and the remainder of the sample or the analysis of the 
sample over a narrow bandwidth. 

Accordingly, techniques used in colorimetric analyses of prepared samples are 
of limited use in the detection and quantification of species of interest due to several 
factors such as, for example, spectral overlapping, mixing of colors due to spatially 

15 overlap of membrane, cytoplasmic, and nuclear markers, chromatic aberrations in the 
optical path, limited spectral resolution of the acquisition device, calibration 
particularities, subjectivity of the detection and quantification process, and 
inconsistencies between human operators. The image processing portion of 
colorimetric analysis techniques has historically been directed to the subjective 

20 detection of contrast within the prepared sample or to a complex and voluminous 

analysis of the sample at various specific wavelengths of light using a combination of 
light sources and filters. Therefore, there exists a need for a simpler and more 
effective colorimetric analysis technique that overcomes detection and quantification 
limitations found in prior art analysis techniques. Such a technique should also be 

25 capable of providing high quality data, comprising the necessary analysis information 
about the sample, while reducing subjectivity and mconsistency in the sample 
analysis. 



6 
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SUMMARY OF THE INVENTION 
The above and other needs are met by the present invention which, in one 
embodiment, provides a method of determining an amount of at least one molecular 
specie comprising a sample, each molecular specie being indicated by a dye. The 
5 amount of the molecular specie is detemiined fix)m an image of the sample captured 
as image data by a color image acquisition device in a video-microscopy system. 
First, an optical density of the sample is determined in each of a red, green, and blue 
channel at a particular pixel in the image. A corresponding optical density matrix is 
thereafter formed for that pixel. The optical density matrix is then multiplied by flie 

1 0 inverse of a relative absorption coefficient matrix so as to form a resultant matrix for 
the pixel. The relative absorption coefficient matrix comprises a relative absorption 
coefficient for each dye, independently of the sample, in each of the red, green, and 
blue channels. Theresultantmatrixthuscomprises the amount of each molecular 
specie, as indicated by the respective dye, for that pixel. 

15 The amount of each molecular specie is determined jfrom a color image of the 

sample. According to one embodiment of the present invention, a color image 
acquisition device, such as an RGB camera and associated frame grabber or a color 
scanner, is used to acquire the image of the sample. The image may then be balanced 
and normalized according to an empty field (white) reference and a black field image 

20 and, in some instances, corrected for shading. The image also corrected for chromatic 
aberrations on a channel by channel basis. Subsequently, an optical density of the 
sample is determined in each of the red, green, and blue chaimels at a particular pixel 
in the image from the measured transmitted hght. A corresponding optical density 
matrix is thereafter formed for that pixel and then multiplied by the inverse of a 

25 relative absorption coefficient matrix of the dyes present in the sample so as to form a 
resultant matrix for the pixel representing the optical density contributions from each 
dye. Since the relative absorption coefficient matrix comprises a relative absorption 
coefficient for each of the dyes used in the sample preparation protocol in each of the 
red, green, and blue channels, the resultant matrix thus comprises the amount, as 

30 expressed in proportion to concentration, of each molecular species as indicated by 
the respective dyes for that pixel. 

Another advantageous aspect of the present invention comprises a video- 
microscopy system for determining an amoimt of a molecular specie comprising a 



wo 03/025554 



PCT/US02/29567 



sample firom an image of the sample, wherein each molecular specie is indicated by a 
dye. The system comprises a color image acquisitioa device capable of capturing a 
magnified digital image of the sample as image data, and a computer device operably 
engaged with the image acquisition device. The computer device comprises a 

S processing portion configured to determine an optical density of the sample &om the 
image data in each of a red, green, and blue channel and at a pixel in the image to 
thereby form a corresponding optical density matrix for the pixel. Another processing 
portion of the computer device is fiuther configured to multiply the optical density' 
matrix by the inverse of a relative absorption coefficient matrix so as to form a 

0 resultant matrix for the pixel of the image. The relative absorption coefficient matrix 
comprises a relative absorption coefficient for each dye, independently of the sample, 
in each of the red, green, and blue channels. The resultant matrix thus comprises the 
amount of each molecular specie, as indicated by the respective dye, for that pixel. 
Still another advantageous aspect of the present invention comprises a 

5 computer software program product configured to be executable on a computer device 
and capable of determining an amount of a molecular specie comprising a sample 
firom a digital image of the sample captured as image data by a color image 
acquisition device ia a video-microscopy system, wherein each molecular specie is 
indicated by a dye. One executable portion of the computer software program product 

0 is capable of determimng an optical density of the sample in each of a red, green, and 
blue channel and at a pixel in the image to thereby form a corresponding optical 
density matrix for the pixel. Another executable portion of the computer software . 
program product is ftirther capable of multiplying the optical density matrix by the 
inverse of a relative absorption coefficient matrix so as to form a resultant matrix for 

5 the pixel of the image. The relative absorption coefficient matrix comprises a relative 
absorption coefficient for each dye, independently of the sample, in each of the red, 
green, and blue channels. The resultant matrix thus comprises the amount of each 
molecular specie, as indicated by the respective dye, for that pixel. 

Such imaging techniques as described herein, otherwise known as multi- 

0 spectral imaging techniques, when particularly ad£5)ted to color imaging, allow a 
substantially real time, or video rate, processing and viewing of the sample. The use 
of, for example, a RGB color CCD camera allows acquisition and processing time for 
sample images to be performed at a video rate, typically 40 millisecond per fi:ame, 

8 
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which provides a considerable advantage as compared to prior art imaging techniques 
which generally exhibit field of view acquisition and processing times of over 1 
second. Where an RGB camera is used by the system, image acquisition through the 
different channels is performed in parallel and look-up tables (LUT) can be generated 
5 so as to map the possible RGB color input values to predetermined concentrations 
and/or transmittance of each of various dyes. Thus, such capabilities may, for 
example, enhance processmg speed and facilitate real time processing for display 
purposes. 

Accordingly, an a posteriori evaluation of tiie image can be performed to 

10 evaluate the efficiency of an a priori known dye combination used to solve the linear 
equations for each pixel. That is, an evaluation as detailed herein also provides a 
confidence evaluation for each pixel in that the color and intensity measured at the 
given pixel may be justified by a combination of the a priori known dyes. Such a 
confidence evaluation can be expressed as the inverse to the closest match in the 

1 5 theoretical model. In a situation in which there are fewer dyes to evaluate than input 
channels (less unknown parameters than equations, e.g. one counter stain + one 
marker (= 2 dyes) when 3 input channels (RGB) are available), the redundant 
information may be used to minimize potential errors and therefore to maximize the 
accuracy of the detection and quantification system. 

20 Thus, embodiments of the present invention comprise a colorimetric analysis 

technique for prepared samples that provides effective detection and quantification of 
species of interest that overcomes limiting factors of prior art techniques such as, for 
example, spectral overlapping, mixing of colors due to spatially overlap of membrane 
and nuclear markers, limited spectral resolution of the acquisition device, calibration 

25 particularities, the subjectivity of the detection and quantification process, and 

inconsistencies between human operators of the analysis equipment. Embodiments of 
the present invention further provide an image processing technique which does not 
rely upon the subjective detection of contrast within the prepared sample or a complex 
and voluminous analysis of the sample at specific wavelengths of light using a 

30 combination of light sources and filters. Therefore, embodiments of the present 
invention provide a simpler and more effective colorimetric analysis technique that 
overcomes detection and quantification limitations in prior art analysis techniques, 
reduces subjectivity and inconsistency in the sample analysis, and is capable of 
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providing the necessary analysis information about the sample, once an image of the 
sample is captured, without relying upon further examiuation of the sample to 
complete the analysis. These and other advantages are realized over prior art 
colorimetric analysis techniques as described herein. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 
Having thus described the invention in general terms, reference will now be 
made to the accompanying drawings, which are not necessarily drawn to scale, and 
wherein: 

1 0 FIG. 1 is a general schematic representation of a quantitative video- 

microscopy system according to one embodiment of the present invention, 

FIG. 2 is a schematic representation of the practical realization in an extended 
configuration of a quantitative video-microscopy system according to one 
embodiment of the present invention. 

15 

DETAILED DESCRIPTION OF THE INVENTION 
The present invention now will be described more folly heremafter with 
reference to the accompanying drawings, in which preferred embodiments of the 
invention are shown. This invention may, however, be embodied in many different 
20 forms and should not be construed as limited to the embodiments set forth herein; 
rather, these embodiments are provided so that this disclosure will be thorough and 
complete, and will folly convey the scope of the invention to those skilled in the art. 
Like numbers refer to like elements throughout. 

The platform for the evaluation of biological samples via image analysis is 
25 increasingly shifting from a general-purpose image analyzer to a more, and often 
highly, specialized dedicated "pathology workstation." Such workstations are 
typically designed to. faciUtate routine work, often combining many of the tools 
needed to provide a pathologist with the necessary information to determine the best 
possible results. One example of such a workstation is illustrated in FIG. 1 as a 
30 quantitative video-microscopy system, indicated by the numeral 100, according to one 
embodiinent of the present invention. The system 100 generally comprises a 
microscope ISO having a Ught source 200 and a magnifying objective 250, a camera 
300, a computer device 350, and a data transmission link 400 between the camera 300 

10 
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and the computer device 350. The microscope 150 may comprise, for example, an 
Axioplan (or Axiovert) microscope produced by ZEISS of Germany or a similar 
microscope having a bright field light source. The camera 300 operably engages the 
microscope 150 and, in one embodiment, comprises a 3CCD RGB camera such as, for 
5 instance, a Model No. DC-330E Dage-MTI RGB 3CCD camera produced by Dage- 
MTI, fcc. of Michigan City, IN or a similar RGB camera. Typically, such a camera 
300 also includes an associated frame grabber (not shown) to facilitate image capture, 
both the camera 300 and associated £rame grabber being referred to herein as the 
"camera 300" for convenience. In some instances, both camera 300 and microscope 

1 0 150 may be replaced by, for example, a linear flat scantier having a 3CCD chip or 
equivalent and a controlled illumination source. For instance, a Model No. Super 
CoolScan 4000 ED scanner produced by Nikon Corporation may be used for low- 
resolution imaging. Note that, though different configurations of the necessary 
system 100 are contemplated by the present invention, the present invention will be 

1 5 described herein in terms of a camera 300 and associated microscope 150. 

Accordingly, one skilled in the art will understand and appreciate the capabilities and 
methodologies associated with these different configurations for accomplishing the 
present invention as detailed herein. 

The camera 300 is generally configured to capture an image 450 of a sample 

20 500 through the magnifying objective 250 (where a flat scanner is used, the image 
450 is captured through internal lenses), wherein the image 450 may further comprise 
a digital image having corresponding image data (collectively referred to herein as 
"the image 450")- The image 450 is generally captured as a whole, wherein the 
corresponding image data comprises a red channel 550, a green channel 600, and a 

25 blue channel 650 image of the field of view. The data transmission link 400 is 

configured so as to be capable of transmitting the image 450 to the computer device 
350, wherein the computer device 350 is fiuther configured to be capable of analyzing 
the image 450 with respect to each of the red 550, green 600, and blue 650 channels. 
According to a particularly advantageous aspect of the present invention, the 

30 system 100 is configured to analyze the sample in accordance vdth the Lambert-Beer 
law. The Lambert-Beer law generally describes a proportionality that can be 
observed between the concentration of molecules in a solution (the concentration of 



11 
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the "molecular specie" or the "sample") and the light intensity measured through the 
solution. The Lambert-Beer law is typically expressed as: 



where OD is the optical density of the solution, 8 is a proportionality constant called 
the molar extinction or absorption coefficient, 1 is the thickness of the sample, and C 
5 is the concentration of the molecular specie. The absorption coefficient e is specific 
to the molecular specie and is typically expressed in units of L-mol'^-cm'^ 

This proportionality relationship defined by the Lambert-Beer law has been 
verified under the several conditions including, for example, monochromatic light 
illuminating the sample, low molecular concentration within the sample, generally no 

10 fluorescence or light response heterogeneity (negligible fluorescence and difiusion) of 
the sample, and lack of chemical photosensitivity of the sample. Further, another 
requirement for an analysis according to the Lambert-Beer law includes, for instance, 
correct Koehler illumination of the sample under the microscope. Koehler 
illimiination is available with many modem microscopes, providing an even 

15 illumination of the sample in the image plane and allowing for effective contrast 
control. Koehler illumination is critical for certain processes such as, for example, 
densitometry analysis. Correct Koehler illumination is typically provided by, for 
example, a two-stage illuminating system for the microscope in which the source is 
imaged in the aperture of the sub-stage condenser by an auxiliary condenser. The 

20 sub-stage condenser, in turn, forms an image of the auxiliary condenser on the object. 
An iris diaphragm may also be placed at each condenser, wherein the first iris controls 
the area of the object to be illuminated, and the second iris varies the numerical 
aperture of the illuminating beam. 



25 comprises several light-absorbing molecular species, for example, Si and Si, having 
respective concentrations Ci and C2, the OD of a sample of thickness 1 (where li = I2 
= 1 for the sample, as indicated in the solution hereinafter) can be expressed as: 



OD^elC 



(1) 



The Lambert-Beer law has an additive propoty such that, if &e sample 



(2) 
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This situation may occur, for example, in a biological analysis where a "scene," a 
field of view, or a portion of the sample has been stained with two dyes consisting of 
a marker dye for targeting the molecular specie of interest and a counterstain for 
staining the remainder of the sample. 
5 In order to accurately measure the concentration of given species imaged 

under a microscope, the measurements of the optical densities performed at different 
wavelengths must specifically correspond to the observed portion of the sample. That 
is, the microscopy system must be corrected for chromatic aberration, wherein such a 
correction or compensation may be accomplished by hardware, software, or a 

10 combination of software and hardware. Generally, glass tends to disperse light, which 
typically causes a simple glass lens to, for example, focus blue lig^t at a shorter 
distance than red Ught That is, a simple glass lens will exhibit different focal lengths 
for light comprising different wavelengths. This dispersion characteristic of glass 
gives rise to two observed effects. Fhrst, longitudinal chromatic aberration, or the 

1 5 positional difference of the focal points for different wavelengths of light along the 
vertical axis, is observed where, upon focusing the image for selected wavelengths of 
light corresponding to a particular color, the image will tend to be slightly out of focus 
when viewed under wavelengths of light corresponding to other colors. For example, 
in an RGB color space, if the image is focused for green wavelengths of light, the 

20 same image will tend to be out of focus when viewed under blue or red wavelengttis 
of light. Secondly, lateral chromatic aberration is observed as a difference in 
magnification for light of different wavelengths due to the different focal lengths 
thereof For example, in an RGB color space, an image viewed under relatively short 
blue light wavelengths will appear larger than the same image viewed under relatively 

25 longer red light wavelengths. 

La microscopy systems having high quality objectives such as, for instance, 
apochromatic objectives, a large portion of the apparent chromatic aberration may be 
corrected. However, some residual lateral chromatic aberration may still remain, 
resulting in differences in magnification across wavelengths of ligjit This lateral 

30 chromatic aberration may be difficult to visually observe since a human observer 
tends to conc^trate on the center of the field of view where the lateral aberration is 
typically absent. However, when imaging the field of view using, for example, a 
CCD camera, a very small lateral chromatic aberration resulting in, for instance, even 
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less that 1% difference in magnification between wavelengths, will result in slight 
color shifts about the edges of objects in the field of view, but located away for the 
optical center of the objective. Consequently, a pixel located at a given (x,y) position 
on the image may not exactly depict the corresponding portion of the object under 
5 investigation depending on the wavelengths of Ught used to illuminate the object and 
the location of the object within the field of view. However, in order to solve 
chromagen separation equations derived from the Lambert-Beer law, a basic premise 
is that the exact same part of the object in the field of view must be examined. 
Therefore, images obtained for separate wavelengths of light must be adjusted to 

1 0 provide correlation with respect to the regions of the field of view where chromagen 
separation equations must be solved. 

Accordingly, one advantageous aspect of the present invention involves a 
method of correcting lateral chromatic aberration within a microscopy system. First, 
the coordinates of the center of the magnifying objective 250 are determined with 

1 5 respect to the center of the electronic device or chip comprising the image-producing 
component of the camera 300. An observed magnification factor is then determined 
for each wavelength and compared to the magnification factor for an arbitrary chosen 
wavelength. For example, in an RGB color space, the central wavelength, namely the 
green channel 600 would comprise the chosen wavelength to which the magnification 

20 factor for each of the red 550 and blue 650 channels would be compared. The image 
for each wavelength is then adjusted according to the determined relative 
magnification factor and the relative coordinates of the center of the magnifying 
objective 250. 

In order to facilitate the first two steps of the described method, a specific 
25 calibration slide is used, wherein the slide is configured with a grid of regularly 
spaced fine holes through a light blocking media. An image of the grid is taken at 
each wavelength of Ught used to illuminate the sample. For example, an image may 
be produced for each of the red 550, green 600, and blue 650 channels. The center of 
each hole is then computed in, for instance, x,y coordinates. The image 
30 corresponding to the wavelength of light nearest to the mean of the wavelengths of 
light under consideration (the green channel600, for example) is then designated as 
the reference image. Subsequently, each of the images for the other wavelength under 
consideration is then compared to the reference- image. For each hole in the grid, the 
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difference in the x direction (8x) and the difference in the y direction (6y) are then 
determined for the corresponding hole in the reference image and the image being 
compared thereto. Equations such as, for example, Unear equations that minimize the 
reconstruction error for 6x as a function of x and 8y as a function of y, are then 
5 determined. From these two equations, the cOTter of the objective (xo,yo) is 

deteraiined, where x© comprising tiie solution of the &st equation in x when 5x is 0 
and yo comprises the solution of the second equation in y when 6y is 0. A linear 
equation that minimizes the reconstmction error of 6d, where 6d == (5x^+8y^)'^, as a 
function of the distance to the center of the objective is then determined, wherein the 
1 0 slope of that equation provides the magnification factor of the particular wavelength 
with respect to the reference wavelength. This image for the particular wavelength is 
then spatially adjusted such that the origin of the image corresponds to the center of 
the objective and the magnification of the image corresponds to the magnification of 
the reference image. 

15 Once the microscope 150 has been configured to provide Keohler illumination 

for image acquisition and chromatic aberrations have been addressed, the additive 
property of the Lambert-Beer law can be applied to chromagen separation. For 
instance, the additive property of the Lambert-Beer law can be expanded to a situation 
in which the scene is analyzed in a color environment, generated by, for example, an 

20 RGB camera, separated into a red, green, and blue channel. In such an instance, the 
marker dye (or "dye 1") exhibits absorption coefficients, eir, ^ig, and ^ib, in the red, 
green and blue channels, respectively. Note that, in some instances, the analysis of 
the image in each of the red, green, and blue channels is equivalent to analyzing a red 
representation of the unage across the red spectra, a green representation of the image 

25 across the green spectra, and a blue representation of the image across the blue 

spectra. Accordingly, the counterstain (or "dye 2") exhibits absorption coefficients, 
«2r, «2g, and a2h> in the red, green and blue channels, respectively. Therefore, 
according to the additive property of the Lambert-Beer law, analysis of the sample in 
the RGB environment leads to three equations for the optical density thereof: 

30 
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ODr = eu ' /l • Ci + Sir 'h^Cz 

ODg = fig • /i • Ci + 82g *h*Ci 
ODb = fib • /i • Ci + €2b • • Ci 



(3) 
(4) 
(5) 



where ODr, ODg, and ODb represent the optical densities of the sample measured in 
the red, green and blue channels, respectively. Still further, m the case of increased 
sample preparation complexity such as, for example, the treatment of the sample with 
5 three different dyes, equations (3), (4), and (5) become: 



In such a situation, the three dyes may comprise, for instance, one marker dye and two 
counterstains, or two marker dyes and one counterstaia, or even three separate marker 
dyes. It will be understood by one skilled in the art, however, that this demonstrated 
property of the Lambert-Beer law may be expanded to included an even greater 

10 plurality of dye combinations in accordance with the spirit and scope of the present 
invention. Note also that one particularly advantageous embodiment of the present 
invention utilizes a fast capture color imaging device such as, for example, a 3CCD 
RGB camera, for multi-spectral imaging of the markers over three distinct (red, green, 
and blue) channels. Accordingly, the exemplary analysis herein is presented in terms 

1 5 of three equations, though one skilled in the art will appreciate that the demonstrated 
concept may be applied to as many channels as are available with a particular imaging 
device. 

In applying the Lambert-Beer law to a digital microscopy system 100 
according to embodiments of the present invention, it is difficult and complex, 
20 inaccurate, or sometimes not possible to measure flie thickness 1 of the sample 500, In 
such instances, the concentration C of the molecular specie can be extended and 
examined as the product of I and C (/ • C) and the results treated accordingly. For 
example, where the concentration of one dye is being compared to the concentration 
of another dye in a particular sample, the sample thickness term will be common to 



ODb = filb ' A • Ci + C2b • h • Ci+fisb • • Ca 



(6) 
(7) 
(8) 
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both concentrations and thus it becomes less important to determine the sample 
thickness as an absolute and accurate value. Accordingly, it will be understood by 
one skilled in the art that an accurate determination of the thickness of the sample is 
typically not required, but may generally be treated as a constant in examining the 
5 equations as detailed herein. 

The application of the Lambert-Beer law to a digital microscopy system 100 
of the preset invention also recognizes that the Lambert-Beer law can also be 
expressed as: 

02)(X^) = log /0(x,y) - log /(x.y) (9) 



for a digital image 450 of the sample 500 comprising a plurality of pixels arranged, 
10 for example, according to a Cartesian coordinate system, where (x,y) signifies a 
particular pixel in the image 450, OD(x^) is ttie optical density of the sample 500 at 
that pixel, I(x,y) is the measured light intensity or transmittance of the sample 500 at 
that pixel, and Io(x,y) is the light intensity of the Ught source 200 as measured without 
any intermediate light-absorbing object, such as the sample. Accordingly: 

lOD = J (log /0(x,y) - log /(x^)) (10) 

IS where lOD is the integrated optical density of the digital image 450 of the sample 
500, and N is the number of pixels in the surface image 450 of the sample. It will 
further be appreciated by one skilled in the art that the logarithmic relationship 
described in equations (9) and (10) may be expressed in various bases within the spirit 
and scope of the present invention. For example, the relationships may be expressed 

20 in base 2, base 10, or natural logarithms, wherein &e various bases are related by 
respective proportionality constants (for example, ki(x) or loge(x) = 2.3026 logio(x)). 
Thus, the proportionality constant may be appropriately considered where relative 
comparisons are drawn in light intensities. Further, in quantitative microscopy 
according to the Lambert-Beer law, the proportionality relationship between the 

25 optical density OD of (he sample and the dye concentrations is conserved. 
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Therefore, for a prepared sample 500 examined by the system 100, the 
appropriate relation is expressed as: 

lnIo-lnI=lnI(/r^OD^€^l'C (11) 

Where, for example, an 8 bit RGB camera 300 is used in the systOTi 100, the 
light intensity transnutted through the sample in each channel may be expressed as 2^ 
5 (=256) values between 0 and 255. For example, the initial intensity Ip of the ligjit 
source 200, which corresponds to 100% transmittance, will preferably be expressed in 
each of the red 550, green 600, and blue 650 chaimels as a value approaching 255, 
representing the brigjitest possible value in each channel. The camera 300 and/or the 
light source 200 may be adjusted accordingly such that, in the absence of the sample, 

10 a pure "white" light will have an intensity value of 255 in each of the red 550, green 
600, and blue 650 channels, corresponding to 100% transmittance. Conversely, in the 
absence of light, generally corresponding to transmittance approaching 0%, a 'T)lack 
image" will have an intensity value approaching 0 in each of the red 550, green 600, 
and blue 650 channels. At any pixel, the initial intensity lo of the light source 200, 

15 corresponding to 100% transmittance, is therefore expressed as the difference 

between the intensity value measured in presence of the light source 200 minus the 
intensity value measured ia absence of the light source 200 for each of the red 550, 
green 600, and blue 650 channels. Because the intensity of the light source 200 may 
vary spatially across the image 450, or over the measured field of view, and becaxise 

20 the magnifying objective 250 or other optical components may heterogeneously 
absorb light, 100% transmittance may be represented by various differential 
intensities over the measured field of view. However, since the optical density OD of 
the sample is expressed as the logarithm of the ratio of light transmittance in absence 
of the sample (initial intensity lo) to light transmittance in presence of the sample (I), 

25 the optical density OD is largely spatially insensitive to small variations in the 
differential intensities over the measured field of view. 

Since the light source 200 remains substantially constant over time, or can be 
easily re-evaluated, the measurement of the light intensity for any pixel, in the 
presence of the sample, can be translated into the transmittance I at that pixel and in 

30 each of the red 550, green 600, and blue 650 channels. Once values for the initial 
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intensity I© and transmittance I are determined, the optical density OD can be 
computed. As such, at any location in the field of view 450 where a unique dye is 
present (as the only light-absorbing object between the light source 200 and the 
camera 300), the absorption coefficient c of that dye may be determined in each of the 
5 red 550, green 600, and blue 650 channels. More particularly, 1-C for a given pixel 
will be equal in each of the red 550, green 600, and blue 650 channels. Thus, if both 1 
and C are known, the absorption coefficient 8 can be computed according to equation 
(11) or in each of tiie red 550, green 600, and blue 650 channels as: 

Sr - ODr/(l'C) = (inao/fr)) /(I'Q (12) 

e, = ODg/(lQ = (ln(I^^)/(l^C) (13) 
= ODi,/(lQ = (ln(rM) /(Z-g (14) 

However, l-C is typically not known for a particular pixel in an image of a 
particular sample. Therefore, the absorption coefficients € are computed for each 
chamiel according to the ratio of the optical density OD in each channel, measured at 
a given pixel, to the maximum optical density OD out of all the channels measured at 
the same pixel. More particularly, it will be appreciated by one skilled in the art that 
the determination of the absorption coefficient e in each of the red 550, green 600, and 
blue 650 channels, in the absence of a priori knowledge of I and/or C, is a matter of 
manipulating the linear equations in order to achieve a relative solution where l-C is 
arbitrarily set to a value of 1, wherein: 

€r = ODr/1 = ODr = ln(Jo/Ir) (15) 

€g = ODg /I = ODg = ln(Iof/Is> (16) 
et^ODb/1 ^ODi,=lnaci/lb) (17) 

Consequently, if the absolute concentration of the particular dye remains unknown, a 
relative absorption coefficient g, in each of the red 550, green 600, and blue 650 
20 chaimels and for any given pixel, may be computed with an error factor equal to 1*C. 
Alternatively, because I is unique at a given pixel location and can be 
arbitrarily set to a value of 1 , equations (6-8) may be rewritten as follow where Ci, Q 
and C3 are related by a factor of 1: 

19 
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ODr = eu • Ci + • Ci^e^r • Ca (18) 

f?/)^ = ^1 g • Ci + f2g • C2 + 53g • C3 (1 9) 

Oi>^ = £ib-Ci + e2b-C2+e3b-C3 (20) 

Note that the determination of an absorption coefficient e matrix for different dyes 
may be performed independently of sample evaluation and stored for further 
application to samples treated with at least one of the respective dyes. Further, the 
various absorption coefficient 8 matrices for particular dyes, as well as the original 
light intensity lo data for the light source 200 may be stored in, for example, the 
computer device 350, a server located on an intranet or the Ihtemet, or other data 
storage device as will be appreciated by one skilled in the art. As such, when 
absorption coefficients e have been evaluated for die different dyes, and optical 
densities OD have been detmnined fix>m image data, the ^ropriate equations may 
be solved as a set of linear equations so as to extract the respective concentrations of 
the dyes Cu C2 and C3. 

By way of further explanation, a representative set of linear algebraic 
equations may be, for example, expressed as: 

at ixi + ai2X2 + ai3X3 + . . . + aiNXN = bi 

a2lXi + a22X2 + a23X3 + . , . + a2NXN - b2 
a3 iXl + a32X2 + a33X3 + . . . + a3NXN = bs 



aMlXi +aM2X2 +aM3X3 + . . . + aMNXN = bM (21) 

15 where, for N unknowns, xj, j = 1, 2,. . N are related by M equations. The coefficients 
ay, where i== 1,2,..., M and j = 1, 2,...,N,are generally known, as are the quantities 
hi, i= 1, 2,.,.,M, IfM<N, there are effectively fewer equations than unknowns. In 
such a case, there can be either no solution or more than one solution matrix x. 
Further, if N = M, then there are as many equations as unknowns and a unique 

20 solution matrix x may likely be determined. In addition, if M >N, then there are more 
equations than unknowns and, in general, no particular solution matrix x to the set of 
equations. Accordingly, the set of equations is said to be over-determined and, in 

20 
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such a case, the most appropriate solution is generally considered to be the solution 
providing the best fit for the equations, wherein the best fit solution typically 
corresponds to the solution having the minimal sum of reconstruction errors. 
Equation (21) may also be alternatively expressed as: 

Ax = b (22) 

where denotes matrix multiplication, A is the matrix of coefficients, and b, is the 
right side portion expressed as a column vector. Generally, by convention, the first 
index of an element aij denotes the element row; while the second index the element 
column. Further, ai.or a[i] denotes an entire row a[i]D], j=l,.. N, Accordingly, the 
solution of the matrix equation A ' x = b for an unknown vector x, where A is the 
matrix of coefficients, and b is the right side portion, usually requires the 
determination of A"^ or the matrix inverse of the matrix A. Thus: 

x=A"^'b (23) 

Since A'^ is the matrix inverse of matrix A, then A ' A"^ = A"* * A = ID, where ID is an 
identity matrix. To facilitate the determination of a solution, parameters may be 
established such that the number of equations is greater than or equal to the number of 
15 unknowns, or M > N. As previously discussed, when M > N occurs there is, in 
general, no particular solution matrix x to equation (21) and the set of equations is 
over-determined. In such situations, however, the best "compromise" or best fit 
solution is often the solution that most closely and simultaneously satisfies all of tiie 
equations. Such closeness maybe defined in, for example, a least-squares manner, 
20 wherein the sum of the squares of the differences between both sides of equation (21) 
is minimized. As a result, the over-determined set of linear equations may typically 
be reduced to a solvable linear problem, often referred to as a linear least-squares 
problem, that may be solved with singular value decomposition (SVD) mathematics 
as will be appreciated by one skilled in the art. SVD is directed to the parametric 
25 modeling of data and is usually the chosen method for solving linear least-squares 
problems and is described in further detail in, for example, NUMERICAL RECIPES IN C: 
THE ART OF SOENTMC COMPUTING (ISBN 0-521-43 108-5) Copyright (C) 1988- 
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1992 by Cambridge University Press. Programs Copyright (C) 1988-1992 by 
Numerical Recipes Software. 

In some situations, pre-computing solutions for all possible pixel values from 
the described system configuration may effectively facilitate real time processing of 
5 the image analysis. More particularly, if an 8 bit color image acquisition device such 
as, for example, an 8 bit 3CCD RGB camera is utilized, the measured light intensity I 
of a sample will have 256 possible values rangmg between limits of 0 and 255 in each 
of the red 550, green 600, and blue 650 channels. In such an instance, all possible 
gray values (256^ possible gray values for an 8 bit system) with respect to the original 

10 light intensity I© may be pre-computed and stored, for example, as a look-up table 
(LUT) within the computer device 350. Thus, for a sample 500 stained with a 
particular dye, the transmitted light intensity I (or the optical density OD) can be 
measured at a pixel in each of the red 550, green 600, and blue 650 channels and then 
compared to the previously stored gray values and the absorption coefficient e matrix 

15 for that particular dye to thereby determine the dye concentration C, or an estimate 
thereof as the product 1*C, at that pixel. Accordingly, an 8 bit system will provide 
256(red channel) x 256(green chamel) x 256(blue channel) = 256^ possible gray 
value solutions, thereby amounting to a 16MB LUT for each dye. A system having a 
gray value resolution exceeding 8 bits per channel will lead to larger LUTs such as, 

20 for example, a LUT of >1GB for a system resolution of 10 bits per channel, wherein 
the computer device 350 may be appropriately configured to provide the necessary 
computing and/or storage capabilities. 

The operation of the system 100 as described above may be further illustrated 
by example, assuming that the light source is a "white" light having Iq = 255 in each 

25 of the red 550, green 600, and blue 650 channels and that three dyes are used having 
the following transmitted light intensity I characteristics in each of the red 550, green 
600, and blue 650 channels: 



I 


Red 


Green 


Blue 


Dyel 


168 


127 


94 


Dye 2 


94 


241 


247 


Dye 3 


120 


94 


155 
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The corresponding optical density OD matrix (each element being computed as 
hi(Io/I)) thus becomes: 



OD 


Red 


Green 


Blue 


Dyel 


0.417 


0.697 


0.998 


Dye 2 


0.998 


0.056 


0.032 


Dye 3 


0.754 


0.998 


0.498 



However, since OD = 8 • 1 • C, the OD values for each dye can be normalized with 
respect to the channel having the highest OD so as to provide a matrix of relative 
S absorption coefficients e for the respective dyes, since the 1 - C values will be constant 
across the channels. Accordingly: 



E 


Red 


Green 


Blue 


Dyel 


0.418 


0.698 


1.000 


Dye 2 


1.000 


0.057 


0.032 


Dye 3 


0.755 


1.000 


0.499 



Subsequently, assuming that a sample 500 has been stained with the same 
three dyes, Dye 1, Dye 2, and Dye 3, and that a light source 200 with similar spectral 
characteristics is used to illuminate the sample 500, an image 450 of the sample 500 is 
10 captured by the camera 300. At a particular pixel in the image 450, the computer 
device 350 then determines that the transmitted light intensity in each of the red 550, 
green 600, and blue 650 channels is: 
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where: 










Red 


Green 


Blue 


I. 


255 


255 


255 



23 



wo 03/025554 



PCTAJS02/29567 



Thus: 





Red 


Green 


Blue 


OD 


1.053 


0.417 


0.504 



for the particular pixel. Therefore, in order to determme the concentrations of the 
three dyes at that pixel, the OD matrix is multiplied by the inverse of the previously- 
detemiined relative absorption coefficiait 8 matrix ( (OD)"e"^ = 1 • C). Accordingly: 





I*C (mole * cm / L) or Crdative 


Dyel 


0.455 


Dye 2 


0.829 


Dye 3 


0.058 



5 According to the methodology described herein, the determined gray levels or, 

in this example, RGB transmittance values from any combination of the three subject 
dyes may be used to reconstruct an artificial image, since there are no unknowns. 
Accordingly, for that particular pixel and the determined dye concentrations, images 
for single dyes would correspond to the following Black and White (BW) or RGB 
1 0 pixel intensities: 

InQiSfy) = In(Io) - ODsm where ODbif = C (24) 
ln(Ir) = ln(Io) - ODn where ODr = «r ' C (25) 
InQg) = InCU) - ODgj where ODg = Cg • C (26) 
biQit) = InOU) - ODb, where ODt « £b • C (27) 

Accordingly: 
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Further advantageous aspects of the present invention are realized as a result 
of the dye separation techniques using color video imaging as previously described 
herein. For exanq^le, an artificial image of the field of view may be generated in an 
RGB color space or in gray levels as a substantially real time or live image, or as a 
5 still image, using combinations of the dyes comprising a marker and/or a counterstain 
used to prepare the sample. More particularly, an artificial image of the field of view 
may be produced which shows ttie sample as affected by all of the dyes, the sample as 
affected by one or more marker dyes, or the sample as affected by the counterstain. 
Consequently, since the dyes used to prepare the sample are characterized by the 

1 0 system, the capabilities of the system may be extended such that, for instance, the 
sample or field of view may be automatically scanned to detect a specific region of 
interest as identified by the characteristics of a particular dye or to affect or facilitate a 
task to be performed on that specific region of interest. 

According to one embodimmt of the present invention, the system may be 

1 5 configured so as to be capable of detecting one or more particular dyes which have 
been previously characterized by the system. In some instances, such a dye may 
comprise, for example, the ink fi'om a particular pen or similar ink marker that has 
been characterized by the system as having unique color features, these unique color 
features being retained by the system as a corresponding set of extinction coefBcients. 

20 It follows that the system may be configured to recognize and respond to portions of . 
the field of view in which this dye is identified and that, in some instances, the one or 
more particular markers may comprise a tangible portion of such a system as 
described herein. For instance, such a pen may be used, for example, where an 
operator such a pathologist or a cytotechnologist identifies special areas of interest on 

25 a sample-containing glass or plastic slide. A special area of interest may comprise, 
for example, a potential diagnostic area or a reference area. The operator, using the 
pen, may then surround the area with a line of ink fix)m that pen. After processing a 
number of slides, the operator may feed the slides into, for instance, an automatic 
scanning system for quantitative evaluation. Having been configured to detect the ink 

30 firom the pen, the system may then inclusively identify the area of interest, 

corresponding to the area within the ink line, circled by the operator with the pen. 
The system may thereafter appropriately process that area of the slide where, for 
example, one color of pen ink may indicate that a particular diagnostic evaluation 

25 
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must be performed, while another color of ink may indicate that the area contains a 
calibration or reference material and would call for the system to run a corresponding 
calibration procedure. Note that, m addition to sUdes, the described technique may be 
readily adapted to examine other mounting forms for microscopic material such as, 
5 for example, microtiter plates or microarrays. Thus, it will be appreciated by one 
skilled in the art that the capabilities of such embodiments of the system, configured 
to recognize particular dyes or mks, may extend to many different automatic scanning 
processes where interactive maridng of areas of interest with specific pens, the pens 
having different color inks previously evaluated by the system, may be used to 
10 automatically designate and actuate a subsequent evaluation or other processing of 
that area of interest by an appropriate component of the system or other specified 
device. 

Additionally, the artificial images of the field of view may also facilitate the 
presentation of the data in a configuration allowing identification and selection of 

1 5 meanmgfiil objects or areas of interest as, for example, still unages in a report 
prepared for diagnostic or other reporting purposes. 

Other advantageous aspects of ttie present invention may also be realized jfrom 
the described system and method herem. For instance, the differences in 
characteristics between the marker dyes and the counterstain, as realized in various 

20 dye-specific images of the sample, may be used to evaluate the focus adequacy of the 
field of view. More particularly, for example, the sample may be treated with two 
separate dyes, one dye comprising a nuclei stain and the other dye comprising a 
membrane stain. In such an instance, an image directed to the membrane stain may 
be evaluated for focus adequacy by examining the focus of the same image directed to 

25 the nuclei stain, wherein the nuclei stain image exhibits a more definite structure upon 
which evaluate focus. 

Still further, the artificial image of the field of view may also be used to 
facilitate the identification and extraction of selected features of the treated sample. 
For example, marked point processes, contextual analysis, and/or geo-statistics may 

30 be used to identify and extract features fi^om the image based on, for instance, a 

spatial distribution analysis of a particular dye. Such a feature extraction cq)ability 
would also allow, for example, fields of view or objects of interest to be sorted, 
flagged, or otherwise identified or grouped based on, for instance, the overall content 
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of a given marker dye or a selected ratio of particular marker. Where, for example, a 
threshold criteria can be established, such a capability would be the detection of rare, 
worsening, or other serious events. Proceeding fiirther, classifiers based specifically 
on the image processing resulting from the counterstain and/or marker dye specific 
5 images may then be established and used to evaluate the presence of certain cell types 
or to perform a diagnosis based upon the field of view. For example, HER2 may be 
evaluated in this manner by comparison to a contmuous diagnosis scale established 
according to the system and methods described herein. Such classifiers may usually 
also encompass other informative features such as, for example, detail based upon fhe 

10 morphology or the texture of the cells. 

Still fiuther, another advantageous aspect of the present invention is realized 
where the system is capable of processing the image data at a faster rate than the 
images ate acquired. The enhanced speed at which the image data is processed may 
allow, for example, features indicated by a particular marker dye to be processed and 

1 5 classified. Accordingly, various conditions may be identified based upon 

predetermined criteria. As such, visual and/or sonic alarms may be established and/or 
mapped in conjunction with the processing of the image data. Thus, in some 
instances, the operator's attention may be directed to a specific field of view or object 
of interest when a characteristic of a marker attains a predetermined level in, for 

20 example, intensity or presence in a particular field, 

FIG. 2 is a schematic representation of a practical realization of an extended 
system configuration according to one embodiment of the present invention. In such 
an implementation, the system 100 or workstation is centered about a microscope 150, 
The microscope 150 may include one or more robotic components including, for 

25 example, a motorized stage, an automatic focus mechanism, a motorized objective 
changer, and an automatic Ught intensity adjustment. The system 100 may also 
include various input devices such as, for instances, cameras 300a and 300b having 
fast automatic focusing and configured for acquiring low-resolution and high- 
resolution images, a flat bed linear scanners 310 used for acquiring low-resolution 

30 images, a grossing station 320, and a voice-recording device 330, which are all linked 
to a computer device 350 through various data transmission links 400. The 
workstation 100 can be part of a Local Area Network (LAN) 700, but may also be 
configured to support different communication protocols such that available 
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communication channels such as, for example, a standard telephone line, an ISDN 
connection, or a Tl line, can readily connect the workstation 100 to other components 
or devices over large distances via a Wide Area Network (WAN) 750 as will be 
^preciated by one skilled in the art. 

5 If the pathology workstation 100 is configured to operate in an integrated 

environment, the WAN 700 or LAN 750 connection may permit access to, for 
instance, existing reference databases 800 and Hosfpital Information Systems (HIS) 
850. Witii such a configuration, new samples and/or cases may readily be compared 
with the pictures and accompanying information of previously-accumulated reference 

10 cases. Further, images acquired &om the samples and/or slides being examined at the 
workstation 100 can be complemented with the patient and case history as necessary. 

In the extended configuration embodiment as shown in FIG. 2, the pathology 
workstation 100 is particularly configured for a comprehensive sample evaluation. 
For example, with information and digital pictures of the initial gross biological 

1 5 sample, images of the slides prepared fiom the sample can be prepared and processed 
as described herein. The patient and case information, the images, and the resulting 
quantitative information about the cell components of the sample and the sample 
architecture (in the case of, for instance, tissue samples) can collected, integrated if 
necessary, and stored in a single database. If, for example, an initial or second expert 

20 opinion is needed or if the slide is used for training or proficiency testing, the 

communication capabilities of the extended configuration along with the automation 
features of the microscope 150 may allow the workstation 100 to be used as a tele- 
pathology system. For example, high-resolution images directed to features or objects 
of interest characterizing a questionable situation on a particular slide may be 

25 electronically forwarded to the expert and/or to the audited candidate. In some 

instances, an overview picture of the slide may be provided, wherein the automated 
microscope 150 is used to scan the slide automatically on, for example, a field by 
field basis. The corresponding digital images may then be stored in the memory of 
tiie computer device 350. Where a field by field basis is used, the edges of adjacent 

30 fields may be precisely matched using correlation algorithms, so as to provide a single 
large overview image of the entire slide. Such an overview image may assist the 
reference pathologist in making an assessment of the information. In some instances, 
the reference pathologist may remotely control the workstation 100 firom a remote site 
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to acquire necessary and/or supplemental images which may be required so as to 
provide a correct and thorough assessment of the slide. 

Subsequently, the information accumulated by the workstation 100 for a 
studied case such as, for instance, real or mathematically generated images, 
5 measurement results and graphical representations thereof patient data, preparation 
data, and screening ma^s, may be selectively integrated into a report which can either 
be printed or accessed electronically. Such a report would provide a conq)rehensive 
picture of the case under evaluation and would also facilitate quality assurance and 
standardization issues. 

10 It will be understood that the methodology and procedures detailed herein in 

conjunction with the system 100 specify a method of quantifying an amount of a 
molecular specie jQrom an image of a sample captured by an RGB camera in a video- 
microscopy systenL One skilled in the art will also appreciate that such a method may 
be automated so as to provide a computer software program product, executable on a 

15 computer device, having executable portions capable of quantifying the amount of a 
molecular specie fiom a digital image of a sample captured by a color image 
acquisition device, such as an RGB camera, m a video-microscopy system. 
Accordingly, embodiments of the system 100 describe the implementation of the 
method and/or the corresponding computer software program product which may be 

20 accomplished in appropriately configured hardware, software, or a combination of 
hardware and software in accordance with the spirit and scope of the present 
invention. 

Thus, embodiments of the present invention comprise a colorimetric analysis 
technique for prepared samples that provides effective detection and quantification of 

25 species of interest that overcomes limiting factors of prior art techniques such as, for 
example, spectral overlapping, mixing of colors due to spatial overlap of membrane 
and nuclear markers, limited spectral resolution of the acquisition device, calibration 
particularities, the subjectivity of the detection and quantification process, and 
inconsistencies between human op^ators of the analysis equipment. Embodiments of 

30 the present invention fiirflier provide an image processing technique which does not 
rely upon the subjective detection of contrast within the prepared sample or a complex 
and voluminous analysis of the sample at specific wavelengths of light using a 
combination of light sources and filters. Therefore, embodiments of the present 
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invention provide a simpler and more effective colorimetric analysis technique that 
overcomes detection and quantification limitations in prior art analysis techniques, 
reduces subjectivity and inconsistency in the sample analysis, and is capable of 
providing the necessary analysis information about the sample, once an image of the 
5 sample is captured, without relying upon further examination of the sample to 
complete the analysis. 

More particularly and as demonstrated, the analysis (detection and 
quantification of a molecular specie of interest) of the prepared sanfiple is 
accomplished through the measurement of light intensities that are manifested m a 

10 digital image of the sample captured by a color image acquisition device. Since the 
analysis is relatively image-dependent, rather than sample-dependent, redundant 
images may be captured for analysis, while many samples may be processed so as to 
capture the necessary images within a relatively short period of time. Once the image 
data has been captured and stored, the actual analysis may occur at a later time or as 

IS needed without requiring the physical presence of fhe actual sample. Such an analysis 
may be further ^plied to examining the entire sample or even the entire slide. Thus, 
embodiments of the present invention provide an expeditious quantitative video- 
nucroscopy system that permits the use of such a system as a routine or '^production" 
tool capable of accomplishing a relatively high analysis throughput. As such, 

20 significant advantages are realized by embodiments of the present invention as 

compared to prior art quantitative microscopy systems which were typically limited in 
sample throughput and analysis, thus generally making such systems more useful as 
research tools. 

Many modifications and other embodiments of the invention will come to 
25 mind to one skilled in the art to which this invention pertains having the benefit of the 
teachings presented in the foregoing descriptions and the associated drawings. 
Therefore, it is to be understood that the invention is not to be limited to the specific 
embodiments disclosed and that modifications and other embodiments are intended to 
be included within the scope of the appended claims. Although specific terms are 
30 employed herein, they are used in a generic and descriptive sense only and not for 
purposes of limitation. 



30 



wo 03/025554 PCTAJS02/29567 

THAT WHICH IS CLAIMED: 

1 . A method of deteroiining an amount of at least one molecular specie 
comprising a sample, each molecular specie being indicated by a dye, from an image 

5 of the sample captured as image data by a color image acquisition device in a video- 
microscopy system, said method comprising: 

determining an optical density of the sample fix>m the image data in each of a 
red, green, and blue channel at a pixel in the image so as to form a 
corresponding optical density matrix for the pixel; and 
1 0 multiplying the optical density matrix by an inverse of a relative absorption 

coefBcient matrix so as to fonn a resultant matrix for the pixel, the 
relative absorption coeflBcient matrix comprising a relative absorption 
coeflBcient for each dye, independently of the sample, in each of the 
red, green, and blue channels, tiie resultant matrix comprising the 
1 5 amount of each molecular specie, as indicated by the respective dye, 

for the pixel. 

2. A method according to Claim 1 further comprising determining the 
relative absorption coefficient for each dye, independently of the sample, in each of 

20 the red, green, and blue channels so as to form the corresponding relative absorption 
coefficient matrix. 

3. A method according to Claim 2 wherein determining the relative 
absorption coefficient further comprises determining an initial intensity of a light 

25 emitted by a light source in each of the red, green, and blue channels. 

4. A method according to Claim 3 wherein determining the relative 
absorption coefficient further comprises illuminating each dye with the light source, 
independently of the sample, and determining a transmitted intensity of the light 

30 transmitted therethrough in each of the red, green, and blue chaxmels. 



5. A method according to Claim 4 wherein determining the relative 
absorption coefficient further comprises comparing the initial intensity of the Ught to 
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the transmitted intensity of light so as to detennine an optical density for each dye in 
each of the red, green, and blue channels. 

6. A method according to Claim 4 wherein determining the relative 

5 absorption coefficient further comprises determining an optical density for each dye 
by determining a natural logarithm of a ratio of the initial intensify of the light to the 
transmitted intensity of the light in each of the red, green, and blue channels. 

7. A method according to Claim 6 wherein determining the relative 

1 0 absorption coefficient further comprises normalizing the optical density in each of the 
red, green, and blue channels, with respect to the channel having the highest optical 
density, for each dye. 



8. A method according to Claim 3 wherein determining an optical density 
15 of the sample further comprises illuminating the sample with the ligiht source and 

determining a transmitted intensity of the Ught transmitted therethrough in each of the 
red, green, and blue channels. 

9. A method according to Claim 8 wherein determining an optical density 
20 of the sample further comprises comparing the initial intensity of the light to the 

transmitted intensity of the Ught so as to determine an optical density for the sample 
in each of the red, green, and blue channels. 

10. A method according to Claim 8 wherein determining an optical density 
25 of the sample further comprises determining a natural logarithm of the ratio of the 

initial intensity of the light to the transmitted intensity of the light through the sample 
in each of the red, green, and blue chaimels. 

11: A method according to Claim 1 further comprising capturing an image 
30 of the sample as image data in each of the red, green, and blue channels of at least one 
of an RGB camera and an RGB-configured scanner. 
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12. A method according to Claim 1 further comprising illxmiinating the 
sample under Koehler illumination conditions. 

13. A method according to Claun 1 further comprising correcting 
5 chromatic aberration in the video-microscopy system. 

14. A method of determining the amount of each of a plurality of 
molecular species comprising a sample, each molecular specie being indicated by a 
dye, at least one dye comprising a marker dye and another dye comprising a 

10 counterstain, fiom an image of the sample captured as image data by a color camera 
in a video-microscopy system, said method comprising: 

determining an optical density of the sample from the image data in each of a 
red, green, and blue channel at a pixel in the image so as to form a 
corresponding optical density matrix for the pixel; and 

1 5 multiplying the optical density matrix by an inverse of a relative absorption 

coefficient matrix so as to form a resultant matrix for the pixel, the 
relative absorption coefficient matrix comprising a relative absorption 
coejQBcient for each dye, independently of the sample, in each of the 
red, green, and blue channels, the resultant matrix comprising the 

20 amount of each molecular specie, as indicated by the respective dye, 

for the pixel. 



15. A method according to Claim 14 further comprising determining the 
relative absorption coefficient for at least the marker dye and the counterstain, 
25 independently of the sample, in each of the red, green, and blue chaimels so as to form 
the corresponding relative absorption coefScient matrix. 



16. A method according to Claim 15 wherein determining the relative 
absorption coefficient fur&er comprises determining an initial intensity of a light 
30 emitted by a light source in each of the red, green, and blue channels. 



17. A method according to Claim 1 6 wherein determining the relative 
absorption coefficient fiirtiber comprises illuminating each dye with the light source, 
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independently of the sample, and measuring a transmitted intensity of the light 
transmitted therethrough in each of the red, green, and blue channels. 

18. A method according to Claim 17 wherein determining the relative 

5 absorption coefficient fiirflier comprises comparing the initial intensity of the light to 
the transmitted intensity of light so as to determine an optical density for each dye in 
each of the red, green, and blue* channels. 

19. A method according to Claim 1 7 wherein determining the relative 

1 0 absorption coefficient further comprises determining the optical density for each dye 
by determining a natural logarithm of a ratio of the initial intensity of the light to the 
transmitted intensity of the light in each of the red, green, and blue channels. 

20. A method according to Claim 19 wherem determining the relative 

15 absorption coefficient further comprises normalizing the optical density in each of the 
red, green, and blue channels, with respect to the channel having the highest optical 
density, for each dye. 

21 . A method according to Claim 16 wherein measuring an optical density 
20 of the sample further comprises illuminating the sample with the light source and 

measuring a transmitted intensity of the light transmitted therethrough in each of the 
red, green, and blue channels. 

22. A method according to Claim 2 1 wherein measuring an optical density 
25 of the sample further comprises comparing the initial intensity of Ihe light to the 

transmitted intensity of the light so as to determine an optical density for the sample 
in each of the red, green, and blue channels. 

23. A method according to Claim 21 wherein measuring an optical density 
30 of the sample further comprises calculating a natural logarithm of the ratio of the 

initial intensity of the light to the transmitted intensity of the light through the sample 
in each of the red, green, and blue channels. 
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24. A method according to Claim 14 further comprising illuminating the 
sample under Koehler illumination conditions. 

25. A method according to Claim 14 further comprising correcting 
5 chromatic aboxation in the video-microscopy system. 

26. A video-microscopy system for determining an amo wit of at least one 
molecular specie comprising a sample, each molecular specie being indicated by a 
dye, from an image of ttie sample, said system comprising: 

a color image acquisition device configured so as to be capable of capturing a 

magnified digital image of the sample as image data; 
a computer device operably engaged with the image acquisition device and 
comprising: 

a processing portion configured to detennine an optical density of the 
sample from the image data in each of a red, green, and blue 
channel at a pixel in the image so as to form a corresponding 
optical density matrix for the pixel; and 
a processing portion configured to multiply the optical density matrix 
by an inverse of a relative absorption coefficient matrix so as to 
form a resultant matrix for the pixel, the relative absorption 
coefficient matrix comprising a relative absorption coefficient 
for each dye, independently of the sample, in each of the red, 
green, and blue channels, the resultant matrix comprising the 
amount of each molecular specie, as indicated by the respective 
dye, for the pixel. 

27. A system according to Claim 26 wherein the image acquisition device 
comprises at least one of a scanner and a microscope operably engaged with a color 
camera. 

30 

28. A system according to Claim 26 further comprising a light source 
directed toward the image acquisition device and configured to emit a light having an 
initial intensity in each of the red, green, and blue channels. 
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29. A system according to Claim 28 wherein the light source is configured 
to illuminate the sample and the processing portion for determining optical density is 
further configured to direct a measurement of a transmitted intensity of the light 

5 transmitted through the sample in each of the red, green, and blue channels. 

30. A system according to Claim 29 wherein the processing portion for 
determining optical density is fiirther configured to compare the initial intensity of the 
lig^t to the transmitted intensity of the Ught so as to determine an optical density for 

10 &e sample in each of the red, green, and blue chaimels. 

31. A system according to Claim 29 wherein the processing portion for 
determining optical density is further configured to calculate a natural logarithm of a 
ratio of the initial mtensity of the light to the transmitted intensity of the light so as to 

15 determine an optical density for the sample in each of the red, green, and blue 
channels. 

32. . A system according to Claim 28 wherein the computer device fiirther 
comprises a processing portion configured to direct the Ught source to illuminate each 

20 dye, independently of the sample, and to direct a measurement of a transmitted 
intensity of the light transmitted therethrough in each of ttie red, green, and blue 
channels. 

33. A system according to Claim 32 wherein the con^uter device further 
25 comprises a processing portion configured to compare the initial intensity of the Ught 

to the transmitted intensity of the Ught so as to determine an optical density for each 
dye in each of fhe red, green, and blue channels. 

34. A system according to Claim 32 wherein the computer device further 
30 comprises a processing portion configured to detennine the optical density for each 

dye by determining a natural logarithm of a ratio of the initial intensity of the Ugjit to 
the transmitted intensity of the Ught in each of the red, green, and blue channels. 
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35. A system according to Claim 34 wherein the computer device further 
comprises a processing portion configured to normalize the optical density in each of 
the red, green, and blue channels, with respect to the channel having the highest 
optical density, for each dye so as to determine the respective relative absorption 

5 coefficient in each of the red, green, and blue channels. 

36. A system according to Claim 26 wherein the computer device fiirther 
comprises a storage media configured to store the relative absorption coefBcient in 
each of the red, green, and blue chaimels for a plurality of dyes, and wherein the dyes 

10 indicating the molecular species in the sample are selected fi:om the plurality of dyes. 



37. A system according to Claim 36 wherein the computer device fiirther 
comprises a processing portion configured to retrieve the respective relative 
absorption coefficients for each dye &om the storage media, and to form the 

15 corresponding relative absorption coefficient matrix, in accordance with the dyes 

indicating the molecular species in the sample which are selected firom the plurality of 
dyes. 

38. A system according to Claim 26 wherein the computer device further 
20 comprises a processing portion configured to invert the relative absorption coefficient 

matrix. 



39. A system according to Claim 28 wherein the Ught source is further 
configured to provide Koehler illimiination conditions. 

25 

40. A system according to Claim 26 wherein the image acquisition device 
is further configured to correct chromatic aberration. 



41 . A computer software program product capable of determining an 
30 amount of at least one molecular specie comprising a sample, each molecular specie 
being indicated by a dye, fiom a digital image of the sample captured as image data 
by a color image acquisition device in a video-microscopy system, said computer 
software program product being executable on a computer device and comprising: 
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an executable portion capable of determining an optical density of the sample 
jfrom the image data in each of a red, green, and blue channel at a pixel 
in the digital image so as to form a corresponding optical density 
matrix for the pixel; and 
S an executable portion capable of multiplying the optical density matrix by an 

inverse of a relative absorption coeficient matrix so as to form a 
resultant matrix for the pixel, the relative absorption coefiQcient matrix 
comprising a relative absorption coeflScient for each dye, 
independently of the sample, in each of the red, green, and blue 
1 0 channels, the resultant matrix comprising the amount of each 

molecular specie, as indicated by the respective dye, for the pixel. 

42. A computer software program product according to Claim 41 further 
comprising an executable portion capable of directing a light source to illuminate the 

1 5 sample with a light having an initial intensity in each of the red, green, and blue 
channels. 

43. A computer software program product according to Claim 42 fiirther 
comprising an executable portion capable of directing a measurement of a transmitted 

20 intensity of the hght transmitted through the sample in each of the red, green, and blue 
channels. 

44. A computer software program product according to Claim 43 wherein 
the executable portion for determining an optical density is ftirther capable of 
comparing the initial intensity of the Ugjit to the transmitted intensity of the light so as 
to determine an optical density for the sample in each of the red, green, and blue 
channels. 

45. A computer software program product according to Claim 43 wherein 
the executable portion for detemaining an optical density is further capable of 
calculating a natural logarithm of a ratio of tiie initial intensity of the light to the 
transmitted intensity of the ligiht so as to determine an optical density for the sample 
in each of the red, green, and blue channels. 
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46. A computer software program product according to Claim 42 further 
comprising an executable portion capable of directing ttie light source to illimiinate 
each dye, independently of the sample, and directing a measurement of a transmitted 

S intensity of the light transmitted therethrough in each of the red, green, and blue 
channels. 

47. A computer software program product according to Claim 46 fijuiher 
comprising an executable portion capable of comparing the initial intensity of the 

1 0 light to the transmitted intensity of the ligjht so as to determine an optical density for 
each dye in each of the red, green, and blue channels. 

48. A computer software program product according to Claim 46 fiirfher 
comprising an executable portion capable of determining the optical density for each 

15 dye by determining a natural logarithm of a ratio of the initial intensity of the light to 
the transmitted intensity of the light in each of the red, green, and blue channels. 

49. A computer software program product according to Claim 48 fiirther 
comprising an executable portion capable of normalizing the optical density in each of 

20 the red, green, and blue channels, with respect to the channel having the highest 
optical density, for each dye so as to determine the respective relative absorption 
coef&cient in each of the red, green, and blue channels. 

50. A computer software program product according to Claim 41 ftirther 
25 comprising an executable portion capable of directing a storage media to store the 

relative absorption coefGcient in each of the red, green, and blue channels for a 
plurality of dyes, and wherein the dyes indicating the molecular species in the sample 
are selected from the plurality of dyes. 

30 51. A computer software program product according to Claim 50 fiirther 

comprising an executable portion capable of retrieving the respective relative 
absorption coefficients for each of the marker dye and the counterstain from the 
storage media, and forming the coire^onding relative absoiption coefGcient matrix, 
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in accordance with the dyes indicating the molecular species in flie sample which are 
selected from the plurality of dyes. 

52. A compute software program product according to Claim 41 ftirther 
5 comprising an executable jportion capable of inverting the relative absorption 

coefiGcient matrix. 

53. A computer software program product according to Claim 42 wherein 
the executable portion capable of directing a light source is further configured to 

1 0 direct the light source to provide Koehler illumination conditions. 



15 



54. A computer software program product according to Claim 41 fiirther 
comprising an executable portion capable of directing the image acquisition device to 
correct chromatic aberration. 



55. A method of determining an amount of at least one molecular specie 
comprising a sample, each molecular specie being indicated by a dye, from an image 
of the sample captured as image data by an RGB camera in a video-microscopy 
system, said method comprising: 
20 determining an optical density of the sample from the image data in each of a 

red, green, and blue channel of the RGB camera and at a pixel in the 
image so as to form a corresponding optical density matrix for the 
pixel; and 

multiplying the optical density matrix by an inverse of a relative absorption 
25 coefficient matrix so as to form a resultant matrix for the pixel, the 

relative absorption coefficient matrix comprismg a relative absorption 
coefficient for each dye, independently of the sample, in each of the 
red, green, and blue channels, the resultant matrix comprismg the 
amount of each molecular specie, as indicated by the respective dye, 
30 for the pixel., 



56. A method according to Claim 55 furtho: comprising determining the 
relative absorption coefficient for each dye, iudependently of the sample, in each of 
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the red, green, and blue channels so as to form the corresponding relative absorption 
coefficient matrix. 

57. A method according to Claim 56 wherein determining the relative 
5 absorption coefficient further comprises determining an initial intensity of a ligiht 

emitted by a ligiht source in each of the red, green, and blue channels of the RGB 
camera. 

58. A method according to Claim 57 wherein determining the relative 

1 0 absorption coefficient fiirfher comprises illuminating each dye with the light source, 
independently of the sample, and measuring a transmitted intensity of the light 
transmitted therethrough in each of the red, green, and blue channels of the RGB 
camera. 

15 59. A method according to Claim 57 wherein determining the relative 

absorption coefficient further comprises determining the optical density for each dye 
by determining a natural logarithm of a ratio of the initial intensity of the light to the 
transmitted intensity of the light in each of the red, green, and blue channels. 

20 60. A method according to Claim 59 wherein determining the relative 

absorption coefficient further comprises normalizing the optical density m each of the 
red, green, and blue channels, with respect to the channel having the highest optical 
density, for each dye. 

25 61 . A method according to Claim 57 wherein measuring an optical density 

of the sample further comprises illuminating the sample with the Ught source and 
measuring a transmitted intensity of &e ligjht transmitted therethrough in each of the 
red, green, and blue chaimels of the RGB cam^a. 

30 62. A method according to Claim 6 1 wh^in measuring an optical density 

of the sample further comprises comparing the initial intensity of the light to the 
transmitted intensity of the light so as to determine an optical density for the sample 
in each of the red, green, and blue channels. 
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63. A method according to Claim 61 wherein measuring an optical density 
of the sample further comprises calculating a natural logarithm of the ratio of the 
initial intensity of the light to the transmitted intensity of the light through the sample 

S in each of the red, green, and blue channels. 

64. A video-microscopy system for detenmning an amount of at least one 
molecular specie comprising a sample, each molecular specie being indicated by a 
dye, from an image of the sample, said system comprising: 

10 a microscope configured to form a magnified image of the sample; 

an RGB camera having a red channel, a green channel, and a blue channel, 
and operably engaged with the microscope so as to be capable of 
forming a digital image from the magnified image; 
a computer device operably engaged with the RGB camera and comprising: 
15 a processing portion configured to determine an optical density of the 

sample in each of the red, green, and blue channels and at a 
pixel in the digital image so as to form a corresponding optical 
density matrix for the pixel; and 
a processing portion configured to multiply the optical density matrix 
20 by an inverse of a relative absorption coefficient matrix so as to 

form a resultant matrix for the pixel of the digital image, the 
relative absorption coefBcient matrix comprising a relative 
absorption coefficient for each dye, independently of the 
sample, in each of the red, green, and blue channels, the 
25 resultant matrix comprising the amoimt of each molecular 

specie, as indicated by the respective dye, for the pixel. 

65. A s}^em according to Claim 64 fiirther comprising a light source 
directed toward the RGB camera and configured to emit a light having an initial 

30 intensity in each of the red, green, and blue channels. 



66. A system according to Claim 65 wherein the light source is configured 
to illuminate the sample with the light and the processing portion for determining an 
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optical density is further configured determine a transmitted intensity of the light 
transmitted through the sample in each of the red, green, and blue channels of the 
RGB camera. 

5 67. A system according to Claim 66 wherein the processing portion for 

detennining an optical density is further configured to determine a natural logarithm 
of a ratio of the initial intensity of the light to the transmitted intensity of the light so 
as to deteraaine an optical density for the sample in each of the red, green, and blue 
chaimels. 

10 

68. A system according to Claim 65 wherein the computer device further 
comprises a processing portion configured to direct fhe light source to illuminate each 
dye with the light source, independently of the sample, and to direct a determination 
of a transmitted intensity of the light transmitted therethrough in each of the red, 
15 green, and blue chaimels of the RGB camera. 



69. A system according to Claim 68 wherein the computer device further 
comprises a processing portion configured to compare the initial intensity of the light 
to the transmitted intensity of the light so as to determine an optical density for each 
20 dye in each of the red, green, and blue channels. 



70. A system according to Claim 68 wherein the computer device further 
comprises a processing portion configured to determine an optical density for each 
dye by determining a natural logarithm of a ratio of the initial intensity of the light to 
25 the transmitted intensity of the Ught m each of the red, green, and blue channels. 



71. A system according to Claim 70 wherein the computer device further 
comprises a processing portion configured to normalize the optical density in each of 
the red, green, and blue channels, with respect to the channel having the highest 
30 optical density, for each dye so as to determine the relative absorption coefficient in 
each of the red, green, and blue channels. 
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72. A system according to Claim 64 wherein the computer device further 
comprises a storage media configured to store the relative absorption coefficient in 
each of the red, green, and blue channels for a plurality of dyes, and wherein the dyes 
indicating the molecular species in the sample are selected from the plurality of dyes. 

5 

73 . A system according to Claim 72 wherein the computer device further 
comprises a processing portion configured to retrieve the respective relative 
absorption coefficients for each dye from the storage media, and to form the 
corresponding relative absorption coefficient matrix, in accordance with the dyes 

10 indicating tiie molecular species in the sample which are selected fix)m the plurality of 
dyes. 

74. A system according to Claim 64 wherein the computer device further 
comprises a processing portion configured to invert the relative absorption coefficient 

15 matrix. 

75. A system according to Claim 65 wherein the Ught source is further 
configured to provide Koehler illumination conditions. 

20 76. A system according to Claim 64 wh^ein at least one of the 

microscope, the RGB camera, and the computer device is further configured to correct 
chromatic aberration. 

77. A computer software program product capable of determining an 
25 amount of at least one molecular specie comprising a sample, each molecular specie 
being indicated by a dye, firom a digital image of the sample captured by an RGB 
camera in a video-microscopy system, said computer software program product being 
configured to be executed on a computer device and comprising: 

an executable portion capable of determining an optical density of the sample 
30 in each of the red, gfeen, and blue channels of the RGB camera and at 

a pixel in the digital image so as to form a corresponding optical 
density matrix for the pixel; and 
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an executable portion capable of multiplying the optical density matrix by an 
inverse of a relative absorption coefficient matrix so as to form a 
resultant matrix for the pixel of the digital image, the relative 
absoiption coefficient matrix conoprising a relative absorption 
5 coefficient for each dye, independently of the sample, in each of the 

red, green, and blue channels, the resultant matrix comprising the 
amount of each molecular specie, as indicated by the respective dye, 
for the pixel. 

10 78. A computer software program product according to Claim 77 further 

comprising an executable portion capable of directing a light source to illuminate the 
sample with a light having an initial intensity in each of the red, green, and blue 
channels. 

15 79. A computer software program product according to Claim 78 fiirther 

comprising an executable portion capable of determining a transmitted intensity of the 
light transmitted through the sample in each of the red, green, and blue channels of 
the RGB camera. 

20 80. A computer software program product according to Claim 79 wherein 

the executable portion for detemuning an optical density is further capable of 
comparing the initial intensity of the light to the transmitted intensity of the hght so as 
to determine an optical density for the sample in each of the red, green, and blue 
channels of the RGB camera. 

25 

81. A computer software program product according to Claim 79 wherein 
the executable portion for deteiminmg an optical density is further capable of 
calculating a natural logarithm of a ratio of the initial intensity of the light to the 
transmitted intensity of the light.so as to determine an optical density for the sample 

30 in each of the red, green, and blue chaimels of the RGB camera. 

82. A computer software program product according to Claim 78 finiher 
comprising an executable portion capable of directing the light source to illuminate 

45 



wo 03/025554 PCT/US02/29567 

each dye, independently of the sample, and directing a determination of a transmitted 
intensity of the light transmitted therethrough in each of the red, green, and blue 
chamiels of the RGB camera. 

S 83 . A computer software program product according to Claim 82 furtho: 

comprising an executable portion capable of comparing the initial intensity of the 
light to the transmitted intensity of light so as to determine an optical density for each 
dye in each of the red, green, and blue channels. 

10 ^84. A computer software program product according to Claim 82 ftirther 

comprising an executable portion capable of determining an optical density for each 
dye by determining a natural logarithm of a ratio of the initial intensity of the light to 
the transmitted intensity of the light in each of the red, green, and blue channels. 

15 85. A computer software program product according to Claim 84 further 

comprising an executable portion capable of normalizing the optical density in each of 
the red, green, and blue chamiels, with respect to the channel having the highest 
optical density, for each dye so as to determine the relative absorption coefficient in 
each of the red, green, and blue channels. 

20 

86. A computer software program product according to Claim 77 further 
comprising an executable portion capable of directmg a storage media to store the 
relative absorption coefficient in each of the red, green, and blue channels for a 
plxirality of dyes, and wherein the dyes indicating the molecular species in the sample 

25 are selected firom the plurality of dyes. 

87. A conqjuter software program product according to Claim 86 further 
comprising an executable portion capable of retrieving the respective relative 
absorption coefficients for each dye from the storage media, and forming the 

30 corresponding relative absorption coeflficient matrix, in accordance with the dyes 

indicating the molecular species in the sample which are selected fix)m the plurality of 
dyes. 
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88. A computer software program product according to Claim 77 further 
comprising an executable portion capable of inverting the relative absorption 
coefficient matrix. 

5 89. A computer software program product according to Claim 78 wherein 

the CTecutable portion capable of directing a light source is further configured to 
direct the light source to provide Koehler illumination conditions. 

90. A computer software program product according to Claim 77 further 
comprising an executable portion enable of directing the RGB camera to correct 
chromatic aberration. 

91. A method of correcting chromatic aberration in a video-microscopy 
system, comprising a light source for emitting light detectable by a magnifying 
objective operably engaged with an image capturing component of an image 
acquisition device, the video-microscopy system being configured to produce a 
image, said method comprising: 

determining a centric coordinate of the magnifying objective with respect to a 

centric coordinate of the image capturing component; 
determining, for a plurality of light wavelengths selected firom the light 
emitted by the light source, a magnification factor for each of the 
plurality of wavelengths with respect to a magnification factor for a 
mean wavelength selected firom the plurality of wavelengths; and 
adjusting the image such that the centric coordinate of the magnifying 

objective corresponds to flie centric coordinate of the image capturing 
component and fiie magnification factor for each wavelength 
corresponds to the magnification factor for the medial wavelength. 

92. A method according to Claim 91 further comprising disposing a slide 
having a calibrated grid of apertures between the light source and the magnifying 
objective. 
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93 . A method according to Claim 92 further comprising forming an image 
of the grid for each of the plurahty of wavelragths and with respect to a Cartesian 
coordinate system having an x axis and a y axis. 

5 94. A method according to Claim 93 further comprising determining a 

centric coordinate wifli respect to the coordinate system for each aperture of the grid 
from the image for each of the of the plurality of wavelengths. 

95. A method accordmg to Claim 94 further comprising designating the 
1 0 image for a mean wavelength as a reference image. 

96. A method according to Claim 95 further comprising determining^ for 
each image with respect to the reference image, and for each aperture of the grid, a 
difference between the centric coordinate of the aperture in the respective image and 

15 the cmtric coordinate of the corresponding aperture in the reference image with 
respect to the coordinate system, the difference being expressed as a differential 
component along the x axis and a differential component along the y axis. 



97. A method according to Claim 96 further comprising determining a 

20 linear equation minimizing a reconstruction error for each of the differential along the 
X axis as a function of x and the differential along the y axis as a function of y. 

98. A method according to Claim 97 further comprising determining the 
centric coordinate of the magnifying objective by solving the linear equation for each 

25 of the differ^tial along the x axis as a function of x and the differential along the y 
axis as a function of y with the differential along the x axis and the differential along 
the y axis being set to a value of zero for the respective luGiear equation. 

99. A method according to Claim 98 further comprising determining a 
30 linear equation for minimizing a reconstruction error of a square root of a sum of tiie 

squares of the differential along the x axis and the differential along the y axis, as a 
function of the distance to the center of the magnifying objective. 
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100. A method according to Claim 99 wherein determining the 
magnification factor for the respective image with respect to the magnification factor 
of the reference image by determining the slope of the linear equation as a function of 
the distance to the center of the magnifying objective. 
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